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Abstract — We propose a technique for reformulation of 
state and parameter estimation problems as that of matching 
explicitly computable definite integrals with known kernels to 
data. The technique applies for a class of systems of nonlinear 
ordinary differential equations and Is aimed to exploit parallel 
computational streams in order to increase speed of calcula- 
tions. The Idea is based on the classical adaptive observers 
design. It has been shown that in case the data Is periodic It may 
be possible to reduce dimensionality of the inference problem 
to that of the dimension of the vector of parameters entering 
the right-hand side of the model nonllnearly. Performance 
and practical Implications of the method are illustrated on a 
benchmark model governing dynamics of voltage In generated 
in barnacle giant muscle. 

Notation 

Symbol || • || stands for the Euclidian norm. By /C we 
denote the set of all strictly increasing continuous functions 
K : lR>o — > ]R.>o such that k(0) — 0. Consider a non- 
autonomous system x = f{x,p, t), where / : lR"xR'*xR — > 
R" is continuous, p E R'' is the vector of parameters, 
and f{-,p,t) is locally Lipschitz; x{- ;to,XQ,p) stands for 
the unique maximal solution of the initial value problem: 
x{tQ;tQ,xo,p) = xq. In cases when no confusion arises, 
we will refer to these solutions as x{-;tQ,xo), x{-;xo), or 
simply x(-). Solutions of the initial value problem above at 
t are denoted as x{t;to,xo), x{t;xo), or x{t) respectively. 
Let / : R ^ R", then ||/(T)||oo,[to,to+T] denotes the 
uniform norm of /(•) on [to, to + T]: \\f{T)\\oo,[to,to+T] = 
ess sup{ 11/(0 II, ^e [to,to + T]}. 

I. Introduction 

Consider a system governed by nonlinear ordinary differ- 
ential equations 



for every t £ [to,to+T]. Let the problem be to find p' e R'^, 
Xq e R" such that 



i = f{x,t,p), x{to) ^ xo, 



(1) 



where / : R" x R x R*"' — > R" is continuous and locally 
Lipschitz wrt the variable x function, and p is the vector 
of unknown parameters. Let [to, to + T] be an interval on 
which the solution x{-\to,xo,p) of ([T]i is defined. Let us 
further suppose that the system's state, x{t;to,xo,p), is not 
accessible for direct observation at any t G [to,to +T]. One 
can, however, observe the values 

h{t,x{t;to,xo,p)), /i:RxR"^R 
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h{t,x{t;to,xo,p)) = h{t,x{t;to,x'o,p')) 
for all t £ [to, to +T]. 



(2) 



This is a standard inverse problem, and many methods 
for finding solutions to this problem have been developed to 
date (sensitivity functions [9], splines [3], interval analysis 
[6], adaptive observers [8], [2], [4], [5], [11] and particle filters 
and Bayesian inference methods [1]). Despite these methods 
are based on different mathematical frameworks, they share 
a common feature: one is generally required to repeatedly 
find numerical solutions of nonlinear ordinary differential 
equations (ODEs) over given intervals of time (solve the 
direct problem). 

Notwithstanding the plausibility of numerical integration 
of systems of ODEs in algorithms for state and parameter 
estimation, this operation is an inherently sequential process. 
This constrains computational scalability of the problem, and 
as a result imposes limitations on the time required to derive 
a solution. In order to overcome this limitation we propose 
to cast the inverse problem above in an alternative, integral 
form. In particular, instead of finding numerical solutions 
of the initial value problem ([T]i and matching the results to 
observed data, e.g. as dU, we search for a representation of 
the problem as 



y{t) - F{p, Xo, t) = 0, for all t £ [to, to+T], 
F{p,xo,t)^ / g{t,T,p,xo)dT, 

J to 



(3) 



where g : R x R x Rp x R" -^ R'' is a function 
explicitly computable from measurement data. Furthermore, 
we additionally require that if p' , Xg is a solution of (O then 
it is also a solution of (|2]l and vise versa. 

In the next sections we specify a class of systems for 
which such representation is possible. This class of systems 
is not as general as ^ but is relevant enough in modelling 
applications. In Section |II] we define this class of systems 
and present general technical assumptions. This is followed 
by presentation of main results in Section |lll] The results 
are based on the periodicity assumption we impose on the 
data and also on known facts from the theory of adaptive 
observes [8], [7]. In Section |IV] we illustrate the approach 
with an example for state and parameter estimation of action 
potential models for neural membranes. 



(4) 



II. Problem Formulation 
Consider the following class of systems 

X = A{e)x + *(y, t)e + v{y, q, A, t) 

9 = P{y,\t)q + w{y,x,t) 

y = C'^x, x{to) = xo, q{to) = go, 

where {x, q), x e R", g e R'' is the state vector, 6 £ K,'", 
A € W are parameters, A{9) is an nx n real matrix, possibly 
dependent on 6, and C £ W, C = col (1, 0, . . . ,0). We 
assume that the following hold for (|4|i: 

Assumption 2.1 (General assumptions on 0); 
Al) the solution of (01) is defined on the interval [io, io 

(for some T > 0, possibly dependent on Iq); 
A2) the pair A(9)^ C, is observable, that is 

/ c^ \ 

C^A{0) 



T] 



rank 



= n; 



A3) P{y, A, t) and '^{y, t) m'e dxd and nxm real matrices 
of which the entries are continuous and differentiable 
functions; P{y,\,t) is diagonal: 

P{y, \ t) = diag (ai(y, A, i), . . . , ad{y, A, t)) ; 

A4) u : R X R'^ X RP X IR ^. R", m; : R X RP X R ^ R'* 

are continuous and differentiable functions. 
A5) Exact values of parameters 9, A are unknown. 

Since the pair A{9),C is controllable there always is a 
nonsingular coordinate transform x i— > T{9,t)x, q i-^ q [E] 
rendering (|4|i into the following form 

x^Aox + bifiy, tf9{9) + i{y, g, A, t) 

q^P{y,\,t)q + wiy,\,t) (5) 

y = C^x, x{to) = .To, g(io) = go, 

,bn-i)'^ is such that the polynomial s"^^ + 
+ bn-i is Hurwitz, and Aq is as follows 



b= (l,&i,.. 



An = 



In-l 





Functions (^ : R x R ^ R^ u : R x Rp x R ^ R" 
are continuous and differentiable, and 9 E W , X E MP are 
parameters. 

Furthermore, noticing that the variable y is defined and 
known for all t E [to,to + T], and y(-) is continuous one 
can express the solution q{t;qo,9,X) on [to, to + T] in the 
closed form as follows: 



/-, /I \^ r/ P(y(T).\,T)dT 

j{t-,qo,9,X) = e-'*o qo+ 



JlPiyi^),\^)ds^^y^^-)^X,T)dT 



Denoting A = col(A,go), g{y,X,t) ^ v{y,q{t;qo,9,X),X,t) 
we therefore arrive at the transformed equations of (0: 



x = Aox + bifiy, tf9{9) + g{y, A, t) 
y = C'^x, x{to) = Xo- 



(6) 



The core problem we are interested in (|6) is as follows: 
Problem 2.1: Let ^ be given, and its solutions are de- 
fined on [to, to + T]. Suppose that all functions in the right- 
hand side of Q are known, but true values of xq, 9, X 
are unknown. Infer the values of x{to);9{9),X from the 
measurements of y{t;to,XQ, 9, A) = C'^x{t;to, xo, 9, A) over 
[to,to + T]. 

The question is if there is an equivalent integral formula- 
tion such as e.g. (O of this problem for (|6)? If such an in- 
tegral formulation exists then whether a reduced-complexity 
version of this formulation can be stated so that the dimen- 
sion of the parameter vector in the reduced formulation is 
smaller that that of in the original problem? Answer to these 
questions are provided in the next section. 

III. Main Result 

A. Indistinguishable paramete rizations of ^ 

We begin with the following property of linear systems 
regarding input detectability (cf [12]) 
Lemma 1: Consider 

X ^ Ax + u{t) + d{t), 

y = C^x, x{to) = Xo, Xo G R", 



(7) 



where 



ai 



A^ 



V 



In~l 





C=(1,0,...,0)^ 



and u,d : R -> R", u E C\ d E C. Let u{-) , u{-) , d{-) be 
bounded: max{||'u(t)||, ||u(i)||} < B, \\d{t)\\ < Aj for all 
t > to. Then 
1) for T sufficiently large, there are ki, K2 G IC: 

l|y(T)||oo,[to,to+T] <e^ 3 t'(e, Xo) > to : 

\\zi{t) + Ui(t)||^ [t, 4^+j,] < Ki{e) + K2(Ac), 

where zi = (1, 0, . . . , 0)z, 



z = Az + Gu, A = 



In -2 




(8) 



G = ( -6 In-l ) , z{to) = 0, 



and b = (fei, . . . , 6„_i) : real parts of the roots of 



bis 



n-2 



bn-1 are negative. 



2) if d(t) = 0, then y{t) = for all t E [to, to + T] imphes 
existence of p G R"^^ 

(1,0,..., 0)e'^(*-*°)p + zi(t) + uiit) = (9) 

for all tE [to,to + T]. 
Proof of Lemma [T] is provided in the Appendix. 

According to Lemma [T] the following two sets of param- 
eters, associated with every 9, A, need special consideration. 
The first set is defined as 

£o{0,X,T) = {{9',X'), e'eR^A'eR'^+P | 

b^iy{t), tf{9' - 9) + g{y{t), A', t) - g{y{t), A, t) - 

for all tE [to,to + T]}. 



The set £0(6, X,T) contains all parameterizations of (|6]l 
which are indistinguishable from each other providing that 
the values of x{t) are known for all t e [to, to+T]. That is, 
if x{t;to,xo,6,\) = x{t;to,XQ,6',X') for all t e [to, to + T] 
then {e',y)e£o{0,X,T). 
Denote 

vie, A, e', X',p, t) = ^{y{t), tf{e' - ~6) + .gi(y(i), a', t) 
- 9i{y{t),X, t) + C^e^(*-*«)p + z^(t; to, X')- 
zi(t;to,X), 

where A, C, z are defined as in ([8]l. The second set can now 
be defined as 

e{e, X, T) = {{9', A'), e' e W, X' e R''+'' [3pe R"-i : 
r]{e,X,e',X',p,t) =0 for alii e [to,to+T]}. 

In accordance with Lemma [T] the set £{0,X,T) contains all 
parametrization of (|6} that are indistinguishable on the inter- 
val [to, to + T] on the basis of accessing only the values of 
y{x{t;to,xo,9,X)). In other words, if y{x{t;to,xo,0. A)) — 
y\x{t;to,x'o,e',X')) for all t € [to,to + T] then (6*', A') e 

^(^~'^'^)- 

Having defined sets £o{d, X, T) and £{0, X, T) we are now 

able to specify the first condition needed for solution of 

Problem im 

Assumption 3.1: Sets £o{0,X,T) and £{9,X,T) coincide 

and contain no more than one element. 

B. Integral reduced-order formulation of the inverse problem 
for (0 

Before we proceed with presenting an equivalent integral 
formulation of Problem 12. II let us first introduce several addi- 
tional components and corresponding technical assumptions. 
In particular, let I E R" be a vector satisfying the following 
condition: 

PiAo + IC^) + (^0 + IC^fP = -Q, Pb - C, 

where P, Q are some symmetric positive definite matrices. 
According to the Meyer-Kalman-Yakubovich-Popov lemma, 
such vector will always exist since the polynomial s"^^ + 
6is"~^ + • • • + bn-i is Hurwitz. 
Consider 

±{ ^i\_{ Ao + lC^ b^{y{t),t) \(ii 

dt\£.2 r\ -^{y{t),t)C^ ; ^2 

(10) 
and let $(t, to) be its corresponding normalized fundamental 
solutions matrix: $(^0,^0) = ^n+r- 

Theorem 3.1: Consider (|6]l and suppose that Assumption 
l3.1l holds. Furthermore, let y{-), Lp{y{-), X, •), g{y{-), X, •) be 
T-periodic on [to, 00] for all A, and the function Lp{y{-),-) 
satisfy: 



to+T 



(p{y{T),T)if{y{T),TfdT > sir, S > 0. 



1) y(A',t) =y(t)foralltG [to , to + T] , where y : R'^+p X 
R^R: 

y{X', t) = (1, 0, . . . , 0) ($(t, to)i?(A') + $(t, to)x 

' g{y{T),X\T)-ly{T)' 



dT) 



i?(A') = (/„+, - $(to + T, to))-i$(to + T, to)x 

r\ir,tor^(^(y(:\>^';^}7^y^^yur. 

Jto 



y{T)ip{y{T),T) 



(11) 



2) y(a;(t;to,xo,e,A'))=2/(t)forallte [to, to+T]. 
Furthermore, the values of xq, 6 satisfy 

'"' ' R{X') 



to 



Then the following statements are equivalent 



(12) 

Proof: Let us first show that 1) => 2). Recall (see 
e.g. [7]) that assumptions of the theorem imply existence 
of positive numbers p, D > 0: 

[\<^{t,t'„)[\ < L>e"''(*-*«) for all t > t^, t,t'Q e [to,oo). 

Hence there are no zero eigenvalues of the matrix /„+r — 
$(to + T, to), and {I^+r - $(to + T, to))-^ exists. 
Consider x = (xi,X2): 

±{ Xi\^{ Ao + lC^ b^{y{t),t) \( XI 
dt\x2 ) \ -v{y{t),t)C'^ )\x2 

g{y{t),X',t)-ly{t) 
y{t)^{y{t),t) 

(13) 

It is clear that solutions of ( fT3T l are defined for all t > 
to providing that the definition of y{-), g(y(-),X' ,■), and 
Lp{-,X' ,■) are extended (periodically) on the interval [to, oo). 
Introduce the function (■(•) = {x{-, to,xo, 9, A), 9) (in which 
the domain of the function x(-, to,xo, ^, A) definition is 
extended to [to,oo)), and consider the difference 

e-x-C 

Dynamics of f satisfy ( fTOb with ^i(to) — Xi(to) — a;(to), 
6(to) = X2{to) - 0. Moreover, y{X',t) = C^Xi{t) for 
all t e [to, to + T] (or in [to,oo) if y{X',-) is periodically 
extended on [to,oo)). 

Let y{X',t) = yit). This implies that X2 ^ ^ = const 
for all t G [tojto + T]. Hence according to Lemma [1] 
(X2(io),A'J belong to £{9,X,T). Given that sets £{9,\T) 
and £o{9, X, T) coincide and contain just one element, 9, A, 
we conclude that X2(io) = 9, X' = X. 

Finally, notice that 

$(t,to)i?(A') + $(t,to)x 

is the unique exponentially stable periodic solution of (fTSl l. 
and that limf^co C(^) — 0- This implies that (fT2l i holds. 

Let us show that 2) => 1), that is 9, X are parameters for 
which the following identity folds y{x{t;to,XQ,9,X')) = 
y{t) for all t G [to,to + T]. Consider the function ({■) 



defined earlier. Given that (fl4t is the unique exponentially 
stable solution of ( fTST l and that linif_j.oo C(i) = for arbitrary 
choice of initial conditions (i.e. vectors 9, x{to), and Xi(^o)^ 
X2{to)) one concludes that y{X' , t) = y{x{t; to, xo,0, A')) — 
y{t)foveLllte[to,to+T]. ■ 

Remark 3.1: One may argue that it is, in principle, pos- 
sible to obtain integral formulations of the corresponding 
inverse problem without using adaptive observer-inspired 
structures. Note, however, that since the original matrix A{9) 
is allowed to depend on unknown parameters 9, explicit 
expressions of solutions of (|5]i will involve extra nonlinearly 
parameterized terms, e"^'^'^*^*"^ If closed-form expressions 
are applied to (|6]l then the drawback is that the overall 
unknown parameters vector is (xq, 9, A), and its dimension is 
n+r+d.ln the proposed solution dimension of the unknown 
parameters vector is reduced to d which is advantageous for 
systems with large number of unknowns. 

Remark 3.2: The uncertainty reduction achieved in the 
proposed method is due to the assumption that all functions 
in the right-hand side of (|6]l are T-periodic. Whereas such 
periodicity assumptions may not always hold, they are not 
particularly difficult to satisfy (at least approximately) in the 
laboratory conditions. 

Remark 3.3: Instead of dealing with continuous-time sig- 
nals, y{t), one may re-formulate the above results for data 
sampled at an N discrete points {ti} in [to, to + T]. In 
this case sets £o, £ will need to be re-defined so that the 
corresponding identities hold at a finite number of points 
{ti} rather than for all i e [to,to + T]. Discrete extension 
of the theorem allows a straightforward formulation of the 
inference problem as 



A 



N 



yiu))' 



(15) 



IV. Example 
Consider the following system: 

i = - 9camcoix){x ~ Eca) - gKq{x - Ek) 
- gL{x - El) + I 

Wooix) 



1 



:i 



(16) 



t{x) t{x) 



y^x, 

where 



mco{x) = 0.5 I 1 + tanh 
Woo {x) =0.5 ( 1 + tanh 



V2 
X-V3 

V4 



t{x) — To cosh 



X-V3 
2V4 



Equations (fT6] l model dynamics of voltage oscillations gen- 
erated in barnacle giant muscle fiber [10]. Variable x is the 
measured voltage, q is the recovery variable. The values of 
Eca, Ek, El are normally known (Eca — —100, Ek — 70, 



TABLE I: True (first row) and Estimated (second) parameter 
values of ( fT6b 

Vector A = (Vi, Va, V3, 14, To, gca, 3x) 



Vi 


V2 


V3 


V4 


To 


gca 


9k 


1 


15 


-10 


14.5 


3 


-1.1 


2 


0.95 


15.08 


-10.15 


14.44 


3.04 


-1.12 


2.02 



Vector e = (gL, I) 



9L 


/ 


-0.5 


10 


-0.539 


10.65 



El = 50); other parameters may vary from one cell to 
another 

It is clear that equations ( fTSI l are of the form (|5). Moreover, 
if the model operates in the oscillatory regime then the right- 
hand side is periodic in t, including the variable q. In addition 
the integral 

rto+T -^ 

ds < 0, 



t{x{s)) 

where if T is the period of oscillations, for practically 
relevant values of To,V3,V4. Assuming that observations 
are taking place when the system's solution are on (or 
sufficiently near) the stable period orbit we can express the 
variable q{t) as follows: 



q[t) ^e-^*o -(-<=» 9o+/ e-l^-~^<M 

Jto 

go =(1 — e '> -'-'.11 ^ 



_,,w^{x{z)) 
t{x{z)) 



to+T 



h rla^js))'^'' °°^ ^ >> ctz. 

to t{x{z)) 

This brings equations ( fTSI l into the form (|6]l with parameters 
9={gL,I), and\^{Vi,V2,V3,Vi,To,gca,gK). 

For the purpose of illustration we set the values of param- 
eters 9, A as specified in Table H] For the data generated at 
these parameter values the system is uniquely identifiable, 
and hence Assumption 13.11 holds. According to Theorem 
13.11 the problem of finding the values of 9, A can be now 
formulated as that of matching the function y{X',t) defined 
in ( fTTT i to y{t) over [to, to+T]. And in view of Remark |331 
it reduces to solving the unconstrained program (IT5i . 

In order to evaluate y{X' ,t), as a function of parameter A' 
at a given t one needs to know the fundamental solutions 
matrix $(i,io) for all t e [to, to + T]. In this example 
this matrix was constructed numerically (using Dormand- 
Prince method and with fixed step size 0.0002) from linearly 
independent solutions of 



-I 


yit) 


1 


-yit) 








-1 









/ = 1 



(17) 



starting from (1, 0, 0)^, (0, 1, 0)"^, and (0, 0, 1)^ 



^-^^ 












/. 




^ t 


' 


\ ^ 












Vz 




number of steps 



20 

15 
10 - 
5 


-5 
-10 

-15 

2 4 6 8 10 xlO^ 

Fig. 1: Estimates and true values of gL, I, V^i/V2, I/V2, V3, 
Vi, Tq, gca, gx 



Points ti in ( fTSl l were evenly spaced with ti+i —ti — 0.04, 
and the BFGS quasi-Newton method was used to find a nu- 
merical estimation of the solution of (fTsT l. For computational 
convenience, instead of looking for Vi , V2 directly we were 
estimating ratios I/V2 and V1/V2 respectively. Similarly, as 
follows from ([TtT i. the estimate of parameter / is not the 
value of 02 but rather is the sum 62 — 6i50. We run the 
method for 12000 iterations, and results of the estimation are 
shown in Table |T] and Fig. [T] In order to verify the quality 
of parameter estimation we run (fT&t with both estimated 
and true values of parameters. Results of this simulation are 
show in Fig. |2l upper panel. Note that the estimated x{t) 
has a higher frequency and that's why there is a noticeable 
difference between trajectories at the end of the interval. 
In order to compensate for this difference we adjusted 
parameter 62 (regulating the frequency of oscillations in 
the original model) by —0.07. Simulated trajectory of (fTSl l 
after this adjustment is shown in Fig. |2] lower panel. It is 
worth noticing that even though both estimated and simulated 
x{t) are matching reasonably well there are still errors. The 
origin of these errors is likely to be 1) due to numerical 
errors in estimating the matrix ^{t,to), and 2) due to the 
ill-conditioning of the original problem. Indeed, as Fig. |3] 
suggests, there is a long shallow valley in a vicinity of the 
optimum. 

The estimation took approximately 1 hour on a standard 
PC in MATLAB. We observed that most of the time was 
spent in the calculations of -^ which is not surprising given 
the integration (fTTl i was performed over a relatively dense 
and uniform grid of points. On the other hand, this indicates 
that in this and similar cases scalability of the procedure is 
expected to grow nearly linear with dimension of A. This 
will be tested in experiments in future. 

V. Conclusion 

We presented a technique for explicit reduced-order in- 
tegral reformulation of inverse problems for a class of 
nonhnear systems. The technique is aimed at using parallel 




Fig. 2: Trajectories x{t) of (fTSl l with true values of 9, X 
(red curves) and estimated values of 9, A from Table U 
(blue curves). The upper panel shows the case when no 
adjustments to estimated parameters were made. The lower 
panel illustrates how the reconstructed x{t) changes when 
the parameter 62 regulating the frequency of oscillations is 
slightly adjusted by —0.07. 



computational streams and is based on the ideas of adaptive 
observers. It has been shown that the method allows to 
reduce dimensionality of the problem to that of the dimension 
of the vector of parameters entering the right-hand side 
of the model nonlinearly. In order to test the viability of 
the method a benchmark model governing dynamics of 
voltage in generated in barnacle giant muscle fiber has been 
chosen. The method performed well in this problem which, 
if coupled with inherent scalability of the procedure, enables 
to hope that the very same inference technology can be used 
successfully for efficient fitting of other models to data too. 
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Appendix 

Lemma 2: Consider y ~ ky + u{t) + d{t), k ^ R, u,d : 
R>t„ ^ R, u e C\ d e C°, and let max{|M(i)|, \u{t)\} < 
B, \d{t)\ < A^. Finally, let T, e be non-negative real 
numbers such that T > y/e. Then 



MV^ . 



||2/||co,[to,to+T] <£^ 

hlloo,[*o,to+T) < Vi(l + e'"!^" + B) + A^. 

Proof: Let L be an arbitrary element of [0, T]. Noticing 

that y{t) for t > io + ^^ -^ > 0, can be expressed as: 

y{t) = y{t-L)e''^ + J^_^e'''-*-''\u{T) + d{T))dT and using 

the Mean-value theorem we obtain: y{t) — y{t — L)e^^ = 



2,e'=(*-^')(u(r') + d(T')), r' G [t-L, i]. Hence e(l + e'^'-^) > 
Le'=(*-^')(|M(t)| -LB- A^), and 



eil + e"^) 



Af + LB , ^ . . ... 
Lnimjl, e"^} 

kL\ 



> 



LB 



e(l + e'=-^) 



Lmin{l,e''^(*-^')} 



> |u(i)| Vt >to + L. 



Given that L can be chosen arbitrarily in the interval 

[0,T] we let L = ^e, and thus \u{t)\ < y/e{l + 
e''^)max{l,e~''^} + B^+A^ < Ve(l + el'=lv^ + B) + 
A^ Vte [to + V^,to + T]. 

Finally, given that \u{t)\ < B for all t e [to, to + T], 
including in the interval [to , io + a/e] , we conclude that 

Ht)\ < ^/i(l + el''^l^ + 2B) + A5 Vte [to,to + T]. 



A. Proof of Lemma [7] 
Let us rewrite (|7) as 

y = aiy + Cx + ui{t) + di{t) 

X — Ax + ay + bui + Gu{t) + d{t), 

where a = col(a2, . . . ,a„), C — col(l, 0, . . . , 0), d{t) 
col{d2{t), . . . ,dn{t)), and 



G^{ -b /„_i 



A 



In-2 




Let ||2/(t)||oo,[to,io+T] < e and denote e{t) = C'^x + ui{t). 

According to Lemma |2] there are wi , W2 G A^ such that 
||e(t)|| = WC^i + ui{t)\\ < vi{e) + W2(A^) for all t G 
[to,to+T]. 

Using the notation above we obtain: x = {A — bC^)x + 
dy{t) + Gu{t) + he{t) + d(t). 

Matrix A — bC'^ = A is Hurwitz, and hence there 
are D,k e lR>o such that ||e^(*"*n)|| < Der^^*-^''\ 
Therefore ||(5'^i(t) - (^"^ // e^(*'^'Gu(T)dr|| < 

7^e-'=(*-*o)||£(to)|| + f(||a||e+||6||(z;i(£)+t;2(Ae)) + A5). 

Noticing that zi = C*^ /^ e^'^^~'^^Gu{T)dT, denoting 
K{e) = 2f (||a||e + \\b\\v,{e)) +v,{e), «:2(A^) = 2f (A^ + 
||fe||w2(A5)) + U2(A^), and 

t'{s,xo)=to + \\n{^^ 

we can conclude that there is a <'(e, xo) > to such that 

||zi(t) + wi(r)||oo,[t,to+T] < K{e) + e + K2(A^) 

^ Kl{e) + K2{A^). 

for all t £ [t'{e, xo), to +T], providing that T is sufficiently 
large to satisfy to + T > t'{e, xo). 

Noticing that y{t) = => e(t) = ensures that ^ holds 
too. D 



